[a?XiV:1101.4456l 

Top quark forward- backward asymmetry, FCNC decays and 
like-sign pair production as a joint probe of new physics 

Junjie Cao^, Lin Wang^'^, Lei Wu^, Jin Min Yang^ 

^ College of Physics and Information Engineering, 

Henan Normal University, Xinxiang 453007, China 

Q ! ^ Key Laboratory of Frontiers in Theoretical Physics, 

p ^1 Institute of Theoretical Physics, Academia Sinica, Beijing 100190, China 

D 

^ . 

■ . Abstract 

The anomaly of the top quark forward-backward asymmetry A^p^ observed at the Tevatron can 

Oh; 

D \ be explained by the i-channel exchange of a neutral gauge boson [Z') which has sizable flavor 

changing coupling for top and up quarks. This gauge boson can also induce the top quark flavor- 
. changing neutral-current (FCNC) decays and the like-sign top pair production at the LHC. In 

\ this work we focus on two models which predict such a Z' , namely the left-right model and the 

I U(l)x model, to investigate the correlated effects on Apj^^ the FCNC decays t^uV {V = g, Z, 7) 

and the like-sign top pair production at the LHC. We also pay special attention to the most 
recently measured A^p^ in the large top pair invariant mass region. We find that under the current 
experimental constraints both models can alleviate the deviation of A^p^ and, meanwhile, enhance 
^ ■ the like-sign top pair production to the detectable level of the LHC. We also find that the two 

models give different predictions for the observables and their correlations, and thus they may 
even be distinguished by jointly studying these top quark observables. 

PACS numbers: 14.65.Ha,14.70.Pw,12.60.Cn 
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I. INTRODUCTION 



In the Standard Model (SM) the top quark is the only fermion with a mass at the 
electroweak symmetry breaking scale and hence is speculated to be a window on new physics 
beyond the SM [il . So far the Tevatron has measured some properties of the top quark and 
found good agreements with the SM predictions except for the forward-backward asymmetry 
Apg, which shows a 2a deviation from the SM expectation j^. Although the latest analysis 
based on the 5.3/6~^ luminosity reduced the deviation to about 1.8a, it indicated that the 
forward-backward asymmetry depends on the top pair invariant mass Mu and for Mu > 450 
GeV the deviation is enlarged to 3Aa Q]. So far various new physics schemes have been 
proposed to explain such a deviation ^-[3], among which one attractive way is the t-channel 
exchange of a neutral gauge boson Z' which has sizable FCNC couphng for top and up 
quarks. 

These Z'-models are especially interesting because, in addition to contributing to A^p^, 
they can also induce the top quark FCNC decays and the like-sign top pair production at 
the LHC. D™ to tKe. suppressed .ates ,n the SM fl a.d the .athe. e>ea. backgrounds 



9l-ll2l|. these FCNC decays and like-sign top pair production can be a good further test of 
the FCNC Z' models for explaination of A^p^. On the other hand, the forward-backward 
asymmetry, the FCNC decays and the like-sign top pair production are correlated with each 
other and such correlations are mo del- dependent and thus can help to distinguish different 
models at the LHC. In this work we concentrate on two such Z'-models, i.e. the left-right 
model and the U(l)x model, to study the correlated effects of top quark forward-backward 
asymmetry at the Tevatron, the FCNC decays t — ?■ uV {V = g, Z,'j) and the hke-sign top 
pair production at the LHC. 

This work is organized as follows. In Sec. II we briefly describe the two models and 
present the calculation of the observables. In Sec. HI some numerical results are presented. 
Finally, we draw conclusions in Sec. IV. 

II. MODELS AND CALCULATIONS 

In extensions of the SM with some extra gauge symmetry, a new neutral gauge boson 
called Z' is often predicted with family universal or non-universal couplings to fermions. 
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FIG. 1: Feynman diagrams contributing to ti production. 

For a Z' with family universal couplings, it contributes to the ti production only via the s- 
channel exchange shown in Fig{T](a). Such s-channel contribution does not interfere with the 
dominant QCD amplitude and thus can not sizably enhance A^p^. However, the situation 
is quite different for a Z' with non-universal couplings where the FCNC interaction Z't^UR 
may arise without violating the constraints from flavor physics [6]. In this case, Z' can 
contribute to ti production via the t-channel exchange shown in Fig{T](b), which, as pointed 
out in gI, can interfere with the QCD amplitude to enhance A*'p^ significantly while alter 
the cross section mildly. Since we attempt to explain the deviation of A'^p^ by new physics 
effects, we in this work consider two models with non-universal Z' couplings, which are 
called model-I and model-II, respectively. 

Model-I extends the SM by a U{l)x gauge symmetry under which the three generations 
of the right-handed up-type quarks are charged as {—l + eu^^uA + ^u) [6]. Therefore 
the new neutral gauge boson Z' predicted in this model only couples to the right-handed 
quarks, and can safely escape the constraints from Drell-Yan measurement at the Tevatron 
and LHc[l^. Meanwhile, in this framework, the Yukawa couplings may be generated by 



the Froggatt-Nielsen type mechanism 15| and the chiral gauge anomalies can be avoided by 
introducing some extra fermions. The Lagrangian relevant to our discussion is {gI 

3 

Ci = g^uYPntZ'^ + eu9xU^rPRU^Zl (1) 

i=l 

where and eu are dimensionless parameters, and i is the generation index. Recently, it is 
found that this model can explain the deviation of A^p^ and meanwhile satisfy other Tevatron 
measurements in the parameter region: 120GeV < m'^ < 170GeV, = 5'^/(47r) < 0.05 and 
^ 0(1), which is obtained by the following consideration j^: 

• If Z' is heavier than top quark, it will decay dominantly to tu or ui and consequently 
give excessive like-sign top quark events through the processes uu — )■ tt, ug — t- tZ' — >■ 
ttu and uu Z' Z' ^ tutu. 
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• If Z' is much lighter than top quark, the exotic decay t uZ' is open. For mz' < 
120 GeV with ax = 0.01, the decay rate will exceed 10%, which can cause a tension 
between the dileptonic and hadronic channels for the tt production at the Tevatron 
because such a light Z' will decay into light quarks. 

• The presence of a small eu is necessary to make the model phenomenologically viable. 
If eu = 0, the only decay mode of Z' is Z' — )■ tu, and then both uu — )■ Z'Z' and ug — )■ 
tZ' can give the very similar like-sign top pair signal, which is strongly constrained 
by the Tevatron experiment. A non-zero eu can avoid this conflict by allowing Z' to 
decay into uu. On the other hand, eu can not be too large because it can enhance the 
rates of both pp Z' ^ dijet and the loop induced decay t — )■ ug, which have been 
constrained by the measurements at the Tevatron. 

Model-II is a special left-right symmetric model called the third-generation enhanced 
left-r,ght model, which is based on the gauge grou^5f/(3)c x SC/(2), x SU(2), x f/(l)«_, 
with gauge couplings g^, gu, gn and g respectively [16]. The key feature of this model is that 
the gauge bosons of the SU{2)r groirp couple only to the third-generation fermions (the 
third generation is specially treated) p, Q. The gauge interactions relevant to our study 



are given by 

z cos uy/ 

+^ tan 61/2 (^^Ll'^^L + i;URa^URi - ^dna'^dBi) {sin ^zZ^ + cosS,zZ') 



-^{tanOn + cot On){nna''Vii:iViit,nn, - Jffi7^<.<,rfiii)(sm^z^M + ^os^zZ'^) (2) 

where tan^/j = g/gn, gy = g cos Or = gRsinOji, ^z is the mixing angle between Zr and Zq, 
are the unitary matrices which rotate the right-handed quarks URi and dju from interaction basis 
to mass eigenstates and the repeated generation indices i and j are summed. Similar to model-I, 
a sizable ur — Ir mixing with other flavor mixings suppressed is allowed by the low energy flavor 
physics 6|]. Such a sizable ur — Ir mixing can lead to a rather strong Z'Irur interaction with the 
condition gR^ gy- 
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FIG. 2: The loop diagrams contributing to t — )• uV{V = g, Z, 7). 
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FIG. 3: Feynman diagrams contributing to tt production. 
Similarly, the interaction to leptons are given as follows 

^11 = ~ o h^iav - gAlb)(^{cosizZ^ - sinizZ'^) 

I cos tjy/ ^ 

+ ^ i^^dR^-hinL - 2ERa^ERi){sinizZ^ + cos^zZ'^) 

- ^{tan 9r + cot 9R){uRr7''j^RT - f Rj''TFi){sm^zZ fj, + cos ^,zZ'^). (3) 

The constraints on model-II were found [l^ to be: coIOr < 20 from the requirement of per- 
turbativity, Mz' ^ 460 GeV for cot 9r_ > 10 from the global fit of the LEP data (especially i?;,)- 
Among the oblique parameters, T gives the most stringent constraint, which roughly requires 
^^M^//(500GeV) < 0.01 at 3cr level. Note that the constraints on mz' from the CDF search for 
new resonant states or from the global fitting of the electroweak precision data are not applicable 
here since they usually assume a Z' with family universal couplings. From the Eqs.(2) and (3), 
we can see that the flavor-conserving interactions between the dominantly right-handed Z' and 
the first two generation fermions are suppressed by small tan^ for the chosen parameters in our 
calculation, and thus make a negligible contribution to the process pp — )• 

Eq.Q indicates that, unlike model-I, model-II gives an interaction Z'tt larger than Z'tu. Al- 
though both models utilize the Z'tu interaction to explain the deviation of A^pR, model-II will have 
more side effects than model-I, e.g., it may also alter sizably R^, the total and the differential rates 
of the tt production. The consideration of all these effects leads to a favorable region characterized 
by a very large gy (10 < cot Or < 20) and a heavy Z' (500GeV < mz' < SOOGeV) [7]. 

Since both models allow for the FCNC Z'tu interaction, they may predict large top quark 
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FCNC decays t — )• uV (V = g, Z,j) and the like-sign top pair production, as shown in Figsl2]and 
[3l The analytic expressions of the loop amplitudes for the FCNC decays are given in Appendix 
A. Three points should be noted here. First, in model-I the processes ug — )• tZ'* — )• ttu and uu — >■ 
Z'*Z'* —7- tutu may lead to signals similar to the tt production, which, however, are suppressed by 
kinematics or high-order effects. Second, in model-II the decay t — )• uZ can proceed at tree level 
via the Z — Z' mixin g, w hile in model-I it can only occur at loop level. Third, for the signature 
ep —7- et at the HERA [1 7], in model I, the lepton-phobic Z' will not contribute to this process and 
can safely avoid the constraints; For the model II, due to the large Z' mass, the process ep — )• et 
is less sensitive to the coupling of Z'ut. Besides, as mentioned above, the small couplings(tan 0) of 
Z'e~^e~ will cancel the large flavor-changing coupling(cot 0) of Z'ut and also not give rise to the 
significant contribution to process ep — t- et. 



III. NUMERICAL RESULTS AND DISCUSSIONS 



The SM parameters used in this calculations are [IS ] 

mt = 172.5GeV,mz = 91.19 GeV, sin^ = 0.2228, as{mt) = 0.1095, a = 1/128. (4) 

For new physics parameters, we scan them within the following ranges: 

Model I : 120 GeV < mz' < 170 GeV, 0.05 < eu < 0.1,0 < < 0.05; 

Model II : 500 GeV < mz' < 2000 GeV, 10 < cot 6* < 20, 0.1 < iV^)ut < 0.2, < < 0.01. 

It should be noted that the contributions to the ti cross section mainly come from the 
flavor- changing t-channel in Fig. 1(b) for both models. Since the suppressions of small flavor- 
conserving coupling eu in model I and tan^ in model II respectively and no interference 
with the SM QCD process, the s-channel mm — t- Z' — > ti has a negligible effects on the 
ti production for both models in our calculations. In additional, the measurements of ti 
cross section at the LHC still have large uncertainties and may not give a new constraints 



on our two models 



191 ]. In our scan, we require the total cross section of the tt production 



and the differential cross section in each bin of M^j to be within the 2a regions of their 



experimental values at the Tevatron 



20 



21| . For model-II, we also consider the constraint 



from the T parameter at 3a level 16| . For the calculation of the hadronic cross sections, we 
use the parton distribution function CTEQ6L 22| with the renormalization scale hr and 
factorization scale fip setting to be mt. 
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FIG. 4: The correlations between Ap^ at the Tevatron, the branch ratio of top FCNC decays 
Br(t — )• uV) and the cross section of the tt production a{tt) at the LHC with ^/s = 14 TeV. 

A. Correlations between different observables 



For each model we show in Fig.4 the correlations between A^p^ at the Tevatron, the branch 
ratios of the top FCNC decays Br(t — )■ uV) and the cross section of the tt production at the 
LHC with ^/s = 14TeV. A common feature of the correlations is that all these quantities 
are proportional to each other. This is obvious since all the quantities receive contributions 
from the same Z'tu interaction. For the forward-backward asymmetry, one can see that both 
models can enhance its value significantly to alleviate the deviation, especially, model-I can 
reduce the deviation to la level. More details about the calculation of Ap^ were presented 
in Q. 

About the FCNC decays, FigJH shows that t — )■ uZ can have a large branching ratio in 
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model-II because it can proceed at tree level via the Z — Z' mixing. For each decay model- 
II gives a larger branching ratio than model-I because in model-I the decays are highly 
suppressed by a factor e^. FigJUalso indicates that in both models the branching ratios for 
these FCNC decays are smaller than 5 x 10^^, which are far below their current experimental 
bounds (namely Br{t ug) < 0.02% from DO 24|, Br{t M7) < 5.2% from ZEUS^ ^ 
and Br{t uZ) < 3.7% from CDF 25|]) and also smaller than the maximal values predictec 



261], Technicolor model [27 1 



29| . one can infer 



in other new physics models such as low energy supersymmetry 
or Little Higgs theory (28 1. From the analysis of top FCNC decays [26 
that detecting these decays in the present two models would be quite challenging at the 
LHC. 

About the like-sign top pair production, FigJH shows that for A^p^ > 6% the cross section 
in both models can be of pb order, reaching Q.Spb in model-I and 3.7pb in model-II. Since the 
signal of such a production is characterized by two isolated like-sign leptons, which is free 



from the tt background and the huge QCD l^-|-jets background IllJl, it may be observable 
at the LHC and will be discussed in the following. 



B. Mass-dependent forward- backward asymmetry at the Tevatron 



We note that very recently the CDF reported the dependence of A^p^ on the top pair 
invariant mass Mu and found a more than 3a discrepancy from the SM prediction for 
Mtt > 450GeV Motivated by this, we display the dependence of Ap^ on Mu in FigJS] In 
our calculation, we have included the SM contribution and multiplied the total cross section 
by a K-factor 1.31 to include the NLO QCD effect 23|]. FigJS] shows that both models can 
enhance A^p^ in large region to ameliorate the discrepancy, though the discrepancy still 
persists at 2a level. Further, we note that both models can also cause top quark polarization 
asymmetry in the tt production at the LHC, which was studied recently in j^, 



^ the ZEUS collaboration gives only the upper limits of the anomalous coupling ntu-y, i^tu-y < 0.174 at 



95% CL. Using this limits and Eq.(41) in arXiv:hep-ph/0003033 in Ref[l], we can obtain the upper limit 
Br{t uj) < 5.2%. 
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FIG. 5: at the Tevatron versus tt invariant mass. 



C. Like-sign top production at the LHC 



Since the hke-sign top production can have a large rate and its background is low, we give 
further study on its observability at the LHC. First, in Figl6]we display some kinematical 
distributions such as the top quark transverse momentum and its pseudo-rapidity ?7t, 
the total transverse energy of the process and the separation between the two 6-jets 



Ai?bb = a/ (A</))^ + (Arj)'^. The new physics parameters are fixed as = 0.026 and rriz' = 
ITOGeV for model-I, and cot^^ = 20 and Vtu = 0.2, niz' = SOOGeV for model-II. For the 
last two distributions in FiglHl we have included the decay chain t — )■ Wb — )■ lub in our code 
to simulate the signals of the process. From the upper two and the last frames we can see 
that the most events are distributed in the region with small transverse momentum or large 
pseudo-rapidity. This implies that for a light Z' in model-I the top quarks tend to outgo in 
parallel with the beam pipe. The third frame shows that the two 6-jets tend to fly in the 
opposite direction since they come from the back-to-back top quarks in the tt rest frame. 
The distinct shapes in the second frame are caused by different masses of Z' in the two 
models (if the Z' mass is assumed to be in the same region for both models, they give the 
similar shapes). 

Now we discuss the detection of the tt production at the LHC with ^/s = 14TeV. We 
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FIG. 6: The p^, r]t, AR^b and Ht distributions for the hke sign top pair production at the LHC. 

choose ifi'jbb = e, /x) as the signal. We simulate the energy resolution of the detector 

effects by assuming a Gaussian smearing for the final leptons and jets 31 1 

5% 



100% 



D 0.55%, for leptons, 
©5% for jets 



(5) 
(6) 



E 

where E is in GeV, and © indicates that the energy-dependent and energy-independent 
terms are added in quadrature. We take the 6-jet tagging efficiency as 50%. The main 
backgrounds are from qq' — )■ ttW^ and qq — )■ W^q'W^q' , which have been studied in lOl. 

n 

In our analysis we take the same cuts as in [10| for the signal: 



> 15 GeV, E^j, > 40 GeV, |r/^|, \r]j\ < 2.5, ARej,ARjj > 0.4, 
M{£iji),M{£232) < 160 GeV, M{e£jj) > 500 GeV, 

10 



(7) 



TABLE I: 3a observation bound on the rate of the tt production at the LHC with -^i = 14TeV 
for 100/6^^ integrated luminosity. 
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FIG. 7: Surviving samples with denoting ax for model-I and Cx denoting (cot 6 + tan 6*)^ 
for model-II. 

where Et denotes the transverse energy and M is the invariant mass of the final states. 
Note that the production pp ^ tt ^ bW^{^ £+z/)6(— )■ )■ jj) can also mimic our 

signal 12|, which, however, has an extra jet and can be suppressed by jet veto. 

Under such cuts we find the acceptance rate of the signal is 15.5% for niz' = 170GeV in 
model-I and 18% for mz' = SOOGeV in model-II. The acceptance rate is found to increase 
with mz', which is 12.8% for m^/ = 120 GeV and increased to 21% for niz' = 2000 GeV. 



With the backgrounds calculated in 10|, we get the 3a sensitivity for the tt production by 
requiring S/y/S + B > 3 for 100/6~^ integrated luminosity. The corresponding results are 
listed in Table I, where one can learn that the tt production with a rate as large as several 
tens of fb can be detected at the LHC. 
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Finally, in Fig|7]we project the surviving samples in the scan on the mz' — C plane with 
C defined as ax in model-I and V^^{cot9 + tan^^)^ in model-II. The solid curves in this 
figure are the Scr sensitivity and above each curve is the observable region. Our results show 
that about 83% (88%) of the total surviving samples lie above the 3cr curve for model-I 
(model-II). Combined with Fig. 4, the points lying below the 3cr curve in FigJ7]give a shift 
of A*p^ less than 0.5%. This fact implies that if the tt production is not observed at the 
LHC, then our considered models may not explain the anomaly of A^pg . 



IV. CONCLUSION 

In this work we studied the correlations between A^p^ at the Tevatron, the FCNC decays 
t — 7- uV(y = g, Z,'~f) and the like-sign top pair production at the LHC in two models with 
non-universal Z' interactions, i.e. the left-right model and the U{l)x model. We also studied 
the dependence of A^p^ on the top pair invariant mass Mu- We found that under the current 
experimental constraints both models can alleviate the deviation of A^p^ and, meanwhile, 
enhance the tt production to the detectable level of the LHC. We also found that, since the 
two models give different predictions for the observables and also their correlations, they 
may be distinguished by jointly studying these observables. In particular, we emphasize 
that exploring the tt production at the LHC will allow for a further test of the models which 
are used to explain the anomaly of A^p^ observed at the Tevatron. 

Note Added : Months after our manuscript finished, the CMS collaboration reported 
their result of searching the like-sign top pair induced by the FCNC Z' at the LHC. The 



limit of the cross section a{pp — )■ tt{j)) < 17.0 pb at 95 % CL[32|. We found that in our 
parameter space, the like-sign top pair cross sections are far bellow the upper limits set by 
the CMS. 
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Appendix A: Analytic expressions for FCNC decay amplitudes 



Here we list the amplitudes for the loop induced processes t — > uV{V — g, 7, Z) shown 
in Fig. 2. The notation M.{q) denotes the amplitude of the diagram with quark q [q — u, t) 
appeared in the loop. 

For model-I, the amplitudes are given by 

Mf\q) = a5.r/Xp„)[-4C"^''7,-7'^ + 2SoS'^-2(|^^-|^j7VCp]Piin(pt)£:(p,), (Al) 

Mf\q) = agsT^^Pu V J V (A2) 

Mf{q) = a5,r/,^2(^,jM±i>!^|2!^^(p,)4(p^), (A3) 

Pt "^u 

M^^\q) = |eat2(p„)[-4C"^''7,-7'^ + 2SoS'^-2(|i^-|ij7VCp]Piin(pt)£:(p^), (A4) 



3 

Mi^Hq) = ^eauipu Y J V <PtVM), (A5) 

3 pi -mi 



M^\q) = |eaS(p„)^^^4^^^4^^(^'*)<(^'7)> (A6) 
6 p^ — m„ 

Mf{u) = -aSaf)gu{pu){^smewtanew)[-4C''fjp--f'' + 2B^j'' 

-2{f^ - pJYYCp]PRuipt)el(pz), (A7) 



^^CoYPr + I sin ew tan ew[-^C''fjp 
COS dw 6 



uiptKipz), (A8) 



M^iq) = -aSc,pgu{pu){^^^^-^ -] 

6 cos Ow 



{2Bj + l)mtp^YPL 



pI - ml 



uiPtKiPz), (A9) 



M^^\q) = -a5^^9u{pu)ilsmewt8.new) ^^^' X (AlO) 

3 Pt - mi 

For model-II, the amplitudes are given by 

Mf\u) = bgsT^MPu)[-^C^'lp - 7^^ + ^B'ol" ' 2(|^, - fJ^''YCM'RPR<PtK{Pg){All) 

M'fHt) = b9sT^MPu){{-^C^'lp-Y + 2B^oY-2{^,-pjrYCp]g'z,RPR 

+^mtC''g'z,LPL - ^mtipu - PtYCog'z'LPL}<Pt)el{Pg), (A12) 
IK. i (2B? + l)mtp Y 97' rPl 

Pu m^ 

Mf\t) = bgsT^MPu){{2Bl + l)mtfyg'z'RPL + (4i?o' - 2)mtf^Y 9'z'lPl 

+{ABl - 2)mW,^,PR}^^^^}^, (A14) 

Pu ''h 
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?3 I l\:^2„,I/^t 



Pt - 



(A15) 



uipt)e:ipg),iAl6) 



+SmtC''gz'LPL - 4mt{Pu - PtVCogziLPL}u{pt)el{p^), 



M^^\u) = -ehu{pu 



pI - 



u{Pt)el{p-i), 



M^^\t) = -ebu{p^){{2B! + l)mtpyg'z>jiPL + {^Bl-2)mtpyg'z'LPL 

u{pt)el{p-y) 



Pi - mi 

2 ^ {2Bl + l)miY9''z'RPR , , , 

3 pf - mi 



(A18) 
(A19) 

(A20) 
(A21) 



Mi^\t) = -ehu{pu) 



{2Bi + l)miY9'zmPR + (4^0 " 2)mtYtt9z'LPL 



p1 - ml 



u{pt)el{p.,). (A22) 



In above expressions, pt and pu denote the momenta of the top and up quark respectively, B and 
C are loop functions defined in jsS] and calculated by Loop Tools [34], the dependence of the loop 
functions on momentums and masses is given by 

B^{q) = B{pt,mz',mg), B^{q) = B{-pu,mq,mz'), 

B^{q) = B{-pt,mg,mz'), C{q) = C{-pu,Pt,mg,mz' ,mq), 



and the constants are defined by 



>^tj.9x 



16^2 -M^-' 

i 



2t/«* t/m 
^ ^Rtu^Rtt 



167r2 4 cos^ 9w sin 9w 
4 . o „ 1 



(tan 9ji + cot Or), 



9z'L ^ i, ^^"^^ ^^''^ § ^^'^ ^^'^ 
9z'R = -^sin^^wC + ^ sin tan - sin 6*^^ (tan + cot 6 B)V^tuVRtu: 
9z'R = sin^ ^wC + ^ sin Ow tan Or - sin 6lvy (tan 0/?^ + cot 61/? jFj^^^ Vrj^ 



(A23) 
(A24) 
(A25) 
(A26) 
(A27) 
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